Annual shoot growth on apple trees with variable canopy leaf area and crop load in response to LiDAR scanned leaf area to fruit ratio

In tree fruit crops, the crop load is one factor that has an influence on the vegetative growth of the trees. However, since trees vary in leaf area and associated fruit bearing capacity, the number of fruit per tree alone is not sufficient to predict their vegetative growth. In the present study, it was investigated whether the leaf area to fruit ratio of trees variable in size and crop load, measured automatically with a LiDAR laser scanner, have an influence on growth properties of the annual shoots. Canopy leaf area, the number of fruit per tree and the leaf area to fruit ratio of apple trees from two commercial apple orchards of the cultivar 'Gala' grown on sandy soils were scanned with a LiDAR laser scanner over a two-year period (n=12 trees per orchard and year). Additionally, the amount of carbon partitioned to fruit and annual shoot growth was quantified for each tree in both years (n=36). No correlation between the number of fruit per tree and the canopy leaf area alone to the amount of carbon partitioned to annual shoot growth was found in both orchards. However, the carbon partitioned to fruit correlated to the leaf area to fruit ratio, while the amount of carbon partitioned to the annual shoot growth was only correlated to the leaf area to fruit ratio in the young orchard. The inter-tree variability in shoot properties has been described. Nevertheless, it was found that the leaf area to fruit ratio is a weak indicator for shoot properties in apple trees, especially in the mature orchards

In-situ fruit analysis by means of LiDAR 3D point cloud of normalized difference vegetation index (NDVI)

A feasible method to analyse fruit at the tree is requested in precise production management. The employment of light detection and ranging (LiDAR) was approached aimed at measuring the number of fruit, quality-related size, and ripeness-related chlorophyll of fruit skin. During fruit development (65 – 130 day after full bloom, DAFB), apples were harvested and analysed in the laboratory (n = 225) with two LiDAR laser scanners measuring at 660 and 905 nm. From these two 3D point clouds, the normalized difference vegetation index (NDVILiDAR) was calculated. The correlation analysis of NDVILiDAR and chemically analysed fruit chlorophyll content showed R2 = 0.81 and RMSE = 3.63 % on the last measuring date, when fruit size reached 76 mm. The method was tested on 3D point clouds of 12 fruit trees measured directly in the orchard, during fruit growth on five measuring dates, and validated with manual fruit analysis in the orchard (n = 4632). Point clouds of individual apples were segmented from 3D point clouds of trees and fruit NDVILiDAR were calculated. The non-invasively obtained field data showed good calibration performance capturing number of fruit, fruit size, fruit NDVILiDAR, and chemically analysed chlorophyll content of R2 = 0.99, R2 = 0.98 with RMSE = 3.02 %, R2 = 0.65 with RMSE = 0.65 %, R2 = 0.78 with RMSE = 1.31 %, respectively, considering the related reference data at last measuring date 130 DAFB. The new approach of non-invasive laser scanning provided physiologically and agronomically valuable time series data on differences in fruit chlorophyll affected by the leaf area to number of fruit and leaf area to fruit fresh mass ratios. Concluding, the method provides a tool for gaining production-relevant plant data for, e.g., crop load management and selective harvesting by harvest robots

Carbon consumption of developing fruit and the fruit bearing capacity of individual RoHo 3615 and Pinova apple trees

This paper describes an approach to estimate the photosynthetic capacity and derive the optimum fruit number for each individual tree, in order to achieve a defined fruit size, which is named as the fruit bearing capacity of the tree. The estimation of fruit bearing capacity was carried out considering the total leaf area per tree as measured with a 2-D LiDAR laser scanner, LALiDAR, and key carbon-related variables of the trees including leaf gas exchange, fruit growth and respiration, in two commercial apple orchards. The range between minLALiDAR and maxLALiDAR was found to be 2.4 m on Pinova and 4.3 m on RoHo 3615 at fully developed canopy. The daily C requirement of the growing fruit and the associated leaf area demand, necessary to meet the average daily fruit C requirements showed seasonal variation, with maximum values in the middle of the growing period. The estimated fruit bearing capacity ranged from 33-95 fruit tree-1 and 45-121 fruit tree-1 on the trees of Pinova and RoHo 3615, respectively. This finding demonstrates sub-optimal crop load at harvest time in both orchards, above or below the fruit bearing capacity for individual trees. In conclusion, the LiDAR measurements of the leaf area combined with a carbon balance model allows for the estimation of fruit bearing capacity for individual trees for precise crop load management. © 2020 Polish Academy of Sciences. All rights reserved

Modeling of Individual Fruit-Bearing Capacity of Trees Is Aimed at Optimizing Fruit Quality of Malus x domestica Borkh. 'Gala'

The capacity of apple trees to produce fruit of a desired diameter, i.e., fruit-bearing capacity (FBC), was investigated by considering the inter-tree variability of leaf area (LA). The LA of 996 trees in a commercial apple orchard was measured by using a terrestrial two-dimensional (2D) light detection and ranging (LiDAR) laser scanner for two consecutive years. The FBC of the trees was simulated in a carbon balance model by utilizing the LiDAR-scanned total LA of the trees, seasonal records of fruit and leaf gas exchanges, fruit growth rates, and weather data. The FBC was compared to the actual fruit size measured in a sorting line on each individual tree. The variance of FBC was similar in both years, whereas each individual tree showed different FBC in both seasons as indicated in the spatially resolved data of FBC. Considering a target mean fruit diameter of 65 mm, FBC ranged from 84 to 168 fruit per tree in 2018 and from 55 to 179 fruit per tree in 2019 depending on the total LA of the trees. The simulated FBC to produce the mean harvest fruit diameter of 65 mm and the actual number of the harvested fruit >65 mm per tree were in good agreement. Fruit quality, indicated by fruit's size and soluble solids content (SSC), showed enhanced percentages of the desired fruit quality according to the seasonally total absorbed photosynthetic energy (TAPE) of the tree per fruit. To achieve a target fruit diameter and reduce the variance in SSC at harvest, the FBC should be considered in crop load management practices. However, achieving this purpose requires annual spatial monitoring of the individual FBC of trees

Estimating Canopy Parameters Based on the Stem Position in Apple Trees Using a 2D LiDAR

Data of canopy morphology are crucial for cultivation tasks within orchards. In this study, a 2D light detection and range (LiDAR) laser scanner system was mounted on a tractor, tested on a box with known dimensions (1.81 m × 0.6 m × 0.6 m), and applied in an apple orchard to obtain the 3D structural parameters of the trees (n = 224). The analysis of a metal box which considered the height of four sides resulted in a mean absolute error (MAE) of 8.18 mm with a bias (MBE) of 2.75 mm, representing a root mean square error (RMSE) of 1.63% due to gaps in the point cloud and increased incident angle with enhanced distance between laser aperture and the object. A methodology based on a bivariate point density histogram is proposed to estimate the stem position of each tree. The cylindrical boundary was projected around the estimated stem positions to segment each individual tree. Subsequently, height, stem diameter, and volume of the segmented tree point clouds were estimated and compared with manual measurements. The estimated stem position of each tree was defined using a real time kinematic global navigation satellite system, (RTK-GNSS) resulting in an MAE and MBE of 33.7 mm and 36.5 mm, respectively. The coefficient of determination (R2) considering manual measurements and estimated data from the segmented point clouds appeared high with, respectively, R2 and RMSE of 0.87 and 5.71% for height, 0.88 and 2.23% for stem diameter, as well as 0.77 and 4.64% for canopy volume. Since a certain error for the height and volume measured manually can be assumed, the LiDAR approach provides an alternative to manual readings with the advantage of getting tree individual data of the entire orchard

Carbon consumption of developing fruit and the fruit bearing capacity of individual RoHo 3615 and Pinova apple trees

This paper describes an approach to estimate the photosynthetic capacity and derive the optimum fruit number for each individual tree, in order to achieve a defined fruit size, which is named as the fruit bearing capacity of the tree. The estimation of fruit bearing capacity was carried out considering the total leaf area per tree as measured with a 2-D LiDAR laser scanner, LALiDAR, and key carbon-related variables of the trees including leaf gas exchange, fruit growth and respiration, in two commercial apple orchards. The range between minLALiDAR and maxLALiDAR was found to be 2.4 m² on Pinova and 4.3 m² on RoHo 3615 at fully developed canopy. The daily C requirement of the growing fruit and the associated leaf area demand, necessary to meet the average daily fruit C requirements showed seasonal variation, with maximum values in the middle of the growing period. The estimated fruit bearing capacity ranged from 33-95 fruit tree-1 and 45-121 fruit tree-1 on the trees of Pinova and RoHo 3615, respectively. This finding demonstrates sub-optimal crop load at harvest time in both orchards, above or below the fruit bearing capacity for individual trees. In conclusion, the LiDAR measurements of the leaf area combined with a carbon balance model allows for the estimation of fruit bearing capacity for individual trees for precise crop load management

Estimation of Vegetative Growth in Strawberry Plants Using Mobile LiDAR Laser Scanner

Monitoring of plant vegetative growth can provide the basis for precise crop management. In this study, a 2D light detection and ranging (LiDAR) laser scanner, mounted on a linear conveyor, was used to acquire multi-temporal three-dimensional (3D) data from strawberry plants (‘Honeoye’ and ‘Malling Centenary’) 14–77 days after planting (DAP). Canopy geometrical variables, i.e., points per plant, height, ground projected area, and canopy volume profile, were extracted from 3D point cloud. The manually measured leaf area exhibited a linear relationship with LiDAR-derived parameters (R2 = 0.98, 0.90, 0.93, and 0.96 with number of points per plant, volume, height, and projected canopy area, respectively). However, the measuring uncertainty was high in the dense canopies. Particularly, the canopy volume estimation was adapted to the plant habitus to remove gaps and empty spaces in the canopy point cloud. The parametric values for maximum point to point distance (Dmax) = 0.15 cm and slice height (S) = 0.10 cm resulted in R² = 0.80 and RMSPE = 26.93% for strawberry plant volume estimation considering actual volume measured by water displacement. The vertical volume profiling provided growth data for cultivars ‘Honeoye’ and ‘Malling Centenary’ being 51.36 cm³ at 77 DAP and 42.18 cm3 at 70 DAP, respectively. The results contribute an approach for estimating plant geometrical features and particularly strawberry canopy volume profile based on LiDAR point cloud for tracking plant growth

Fruit sizing using AI: A review of methods and challenges

Fruit size at harvest is an economically important variable for high-quality table fruit production in orchards and vineyards. In addition, knowing the number and size of the fruit on the tree is essential in the framework of precise production, harvest, and postharvest management. A prerequisite for analysis of fruit in a real-world environment is the detection and segmentation from background signal. In the last five years, deep learning convolutional neural network have become the standard method for automatic fruit detection, achieving F1-scores higher than 90 %, as well as real-time processing speeds. At the same time, different methods have been developed for, mainly, fruit size and, more rarely, fruit maturity estimation from 2D images and 3D point clouds. These sizing methods are focused on a few species like grape, apple, citrus, and mango, resulting in mean absolute error values of less than 4 mm in apple fruit. This review provides an overview of the most recent methodologies developed for in-field fruit detection/counting and sizing as well as few upcoming examples of maturity estimation. Challenges, such as sensor fusion, highly varying lighting conditions, occlusions in the canopy, shortage of public fruit datasets, and opportunities for research transfer, are discussed.This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017 SGR 646 and 2021 LLAV 00088) and by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / FEDER (grants RTI2018-094222-B-I00 [PAgFRUIT project] and PID2021-126648OB-I00 [PAgPROTECT project]). The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.info:eu-repo/semantics/publishedVersio

Apple Shape Detection Based on Geometric and Radiometric Features Using a LiDAR Laser Scanner

Yield monitoring systems in fruit production mostly rely on color features, making the discrimination of fruits challenging due to varying light conditions. The implementation of geometric and radiometric features in three-dimensional space (3D) analysis can alleviate such difficulties improving the fruit detection. In this study, a light detection and range (LiDAR) system was used to scan apple trees before (TL) and after defoliation (TD) four times during seasonal tree growth. An apple detection method based on calibrated apparent backscattered reflectance intensity (RToF) and geometric features, capturing linearity (L) and curvature (C) derived from the LiDAR 3D point cloud, is proposed. The iterative discretion of apple class from leaves and woody parts was obtained at RToF > 76.1%, L < 15.5%, and C > 73.2%. The position of fruit centers in TL and in TD was compared, showing a root mean square error (RMSE) of 5.7%. The diameter of apples estimated from the foliated trees was related to the reference values based on the perimeter of the fruits, revealing an adjusted coefficient of determination (R2adj) of 0.95 and RMSE of 9.5% at DAFB120. When comparing the results obtained on foliated and defoliated tree’s data, the estimated number of fruit’s on foliated trees at DAFB42, DAFB70, DAFB104, and DAFB120 88.6%, 85.4%, 88.5%, and 94.8% of the ground truth values, respectively. The algorithm resulted in maximum values of 88.2% precision, 91.0% recall, and 89.5 F1 score at DAFB120. The results point to the high capacity of LiDAR variables [RToF, C, L] to localize fruit and estimate its size by means of remote sensing

An approach for monitoring temperature on fruit surface by means of thermal point cloud

Heat and excessive solar radiation can produce abiotic stresses during apple maturation, resulting fruit quality. Therefore, the monitoring of temperature on fruit surface (FST) over the growing period can allow to identify thresholds, above of which several physiological disorders such as sunburn may occur in apple. The current approaches neglect spatial variation of FST and have reduced repeatability, resulting in unreliable predictions. In this study, LiDAR laser scanning and thermal imaging were employed to detect the temperature on fruit surface by means of 3D point cloud. A process for calibrating the two sensors based on an active board target and producing a 3D thermal point cloud was suggested. After calibration, the sensor system was utilised to scan the fruit trees, while temperature values assigned in the corresponding 3D point cloud were based on the extrinsic calibration. Whereas a fruit detection algorithm was performed to segment the FST from each apple. • The approach allows the calibration of LiDAR laser scanner with thermal camera in order to produce a 3D thermal point cloud. • The method can be applied in apple trees for segmenting FST in 3D. Whereas the approach can be utilised to predict several physiological disorders including sunburn on fruit surface